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(54) ROBOT DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To permit a meeting with a 
realistic feel such that an operator views the condition of 
the meeting, listens, shows expressions, speaks, 
presents data, shakes hands, etc., via a robot brought to 
a remote meeting room. 

SOLUTION: This robot device comprises a robot body 
with a camera 1 , a stereo microphone 3, a display 2 for 
displaying expressions, a speaker 4, a CPU body, a 
communications unit 5, a telescopic mechanism 7 and a 
travel device 9; and an operating terminal with a display 
30, a head operating portion, a line-of-sight operating 
portion 32, an arm drive and operating portion, a travel 
operating portion 34, a telescopic movement operating 
portion 36, a voice adjusting portion 37, a 
communications unit 38, and a stereo headphone and microphone 22 having an image pickup 
portion 21. 



m 




LEGAL STATUS 



http://wwl9.ipdl.ncipi.go.jp/PAl/result/detail/main/wAAAPgaytcDA4140460 9/15/2005 



Searching PAJ 



Page 2 of 2 



[Date of request for examination] 

[Date of sending the examiner's decision of 

rejection] 

[Kind of final disposal of application other than 
the examiner's decision of rejection or 
application converted registration] 
[Date of final disposal for application] 
[Patent number] 
[Date of registration] 
[Number of appeal against examiner's 
decision of rejection] 

[Date of requesting appeal against examiner's 
decision of rejection] 
[Date of extinction of right] 

Copyright (C); 1998,2003 Japan Patent Office 



http://wwl9.ipdl.ncipi.gpjp/PAl/result/detail/main/wAAAPgaytcDA414046088Pl.htm 9/15/2005 



JP,2002-046088,A [CLAIMS] 



Page 1 of 1 



* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] It is robot equipment which consisted of a robot body and an operating station for operating 
this robot body by remote control. Said robot body The camera which photos a vision environment 
continuously, and the microphone which catches agsastis environment as a sound signal, The robot 
display which displays an operator^jXEESgsion, and the loudspeaker which outputs the voice about 
which an operator speak s, The CPU body which performs data p rocessing of th e whole robot body, and 
control, and the robot co mmunication link unit which transm it and receive inform ation between said 
ogeratingstations, The operating station display which disp lays the image to which it has the skill 
sectionwHich is the skill which can exerd se, and the transit section for migration, and said operating 
station was sent from said camer a, The head control unit which operates movement of the head of said 
robot body, and the look control unit which operates migration of bearing which said camera photos, 
The skill drive control unit which operates movement of said skill section, and the transit control unit 
which operates movement of said transit section, The sound-v olume control ler which carries out 
adjustment actuation of the sound volume of the voice outputted from said loudspeaker, The operating 
station communication link unit f or transmitti ng and receiving infor mation between said robot bodies. 
Robot equipment characterized by having a h eadphone micro phone for talking that it is attached to said 
operating station, have the image pick-up jsection for photoing an operator's expression, and the sound 
signal from said microphone is heard, and it outputs to said loudspeaker. 
[Claim 2] The head control unit of said operating station is robot equipment according to claim 1 
characterized by making a switch of a function at a look control unit by actuation of a head / look 
change-over switch. 

[Claim 3] The skill drive control unit of said operating station is robot equipment according to claim 1 
characterized by making a switch of a function at a transit control unit by actuation of skill / transit 
change-over switch. 

[Claim 4] Robot equipment according to claim 1 characterized by having been attached to said operating 
station, having replaced with the headphone microphone equipped with the image pick-up section, and 
building the image pick-up section, a loudspeaker, and a microphone in said operating station. 
[Claim 5] Robot equipment according to claim 1 characterized by having formed the laser pointer in the 
skill section of said robot body, and preparing the switch which carries out flashing of said laser pointer, 
and accommodation of the projection direction to said operating station, and a controller. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the robot equipment which serves as an operator's other 
self and acts and which is especially used for teleconferencin g etc. 
[0002] " ^ 

[Description of the Prior Art] Conventional robot equipment had the industrial robot which does the 
activity of welding, paint, or an assembly instead of human being and which has action controlled by the 
program, and various kinds of sensors and an autonomous type robot with CPU. Moreover, in the 
conventional video conference system, it was what performs an arrangement in a remote place by 
transmitting two or more voice and images of a remote conference hall to a mutual conference hall. 
[0003] 

[Problem(s) to be Solved by the Invention] However, conventional robot equipment was what [ only ] 
carries out fixed actuation to the condition of having repeated the actuation for which the operator itself 
does not grasp the situation of robot equipment and it generally opted, or having been decided, operating 
it. 

[0004] Furthermore, although the signal transduction between two or more re mote conference halls is 
based on voice and an image and the arrangement in a remote place was once completed in the 
conventional video conference system, for the participant, it was what I hear that the voice and the 
image which were edited with automatic or hand control must be received, heard and seen, and it is 
passive, and there is no sense of togetherness among participants compared with a meeting in the same 
room, and lacks in presence. s 

I [0005] This invention is made in view of such a point, the robot equipment of this invention transmits 
the perimeter situation of a robot body to an operator, and it aims at offering the outstanding robot 
equipment which can serve as an operator's own other self. 
[0006] 

[Means for Solving the Problem] In order to solve the above-mentioned problem the robot equipment of 
this invention It is robot equipment which consisted of a robot body and an operating station for 
operating this robot body by remote control. Said robot body The camera which pho tos a visio n 
e nvironment continuou sly, and the microphon e which catches acoustic env ironment as a sound signal, 
The robot disp lay which displays an operator 's expression, and the loudspeakerwhich outputs the voice 
about which a n operator spe aks, The CPU body which performs data processing of said whole robot 
body, and control, The robot communication link unit which tran smits and rece ives information between 
said operating stations, and the skill section which is the skill which canbe exercised, The operating 
station display which displays the image to which it has the transit section for migration and said 
operating station was sent from said camera, The head control unitwhich o perates movement of the 
head of said robot body, and the look controj junit which operates migration of bearing which said 
camera photos, The skill drive control unit which operates movement of said skill section, and the transit 
control unit which operates movement of said transit section, The sound-volume controller which carries 
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out adjustment actuation of the sound volume of the voice outputted from said loudspeaker, The 
operating station communication link unit for transmitting and receiving information between said robot 
bodies, It is attached to said operating station, and has the image p ick-up ge ctjon for photoing an 
operator's expression. The robot equipment characterized by having a headpho ne microphone for talking 
that the sound signal from said microphone is heard, and it outputs to said loudspeaker can be" offered, 
and confrontation negotiation can be carried out as an operator's substitute. 

[0007] Furthermore, the head control unit of said operating station is made to be made by switch of a 
function at a look control unit by actuation of a head / look change-over switch, and the robot equipment 
of this invention can make a control unit serve a double purpose. 

[0008] Moreover, the skill drive control unit of said operating station is made to be made by switch of a 
function at a transit control unit in actuation of skill / transit change-over switch, and the robot 
equipment of this invention can make a control unit serve a double purpose. 

[0009] Moreover, the robot equipment of this invention can be attached to said operating station, can be 
replaced with said headphone microphone equipped with the image pick-up section, and can contain the 
image pick-up section, a loudspeaker, and a microphone in said operating station, and an image and 
voice can be sent and received by the operating station. 

[0010] Moreover, the robot equipment of this invention enables flashing of said laser pointer, and 
accommodation of the projection direction by forming a laser pointer in the skill section of said robot 
body, and preparing the switch and controller which carry out flashing of said laser pointer, and 
accommodation of the projection direction to said operating station. 
[0011] 

[Embodiment of the Invention] Drawing 1 is drawing showing the whole robot equipment system, 
among those drawing 1 (a) is drawing showing the appearance of a robot body. The head of a robot body 
is equipped with the came ra 1, the displa y 2, and the stereo microphone 3 in drawing 1 (a). Idiosoma is 
equipped with a loudspeaker 4, the communicatio n link unit 5 for transmitting and receiving to a CPU 
body and operator side, and two skill. There is a laser pointer 6 for directing drawing etc. in one skill. 
Between idiosoma and a foot, it connects according to the flexible devicej, and the foot is equipped 
with the power unit 8 and the traveller 9. 

[0012] Drawing 1 (b) is drawing showing actuation of an operator. In drawing 1 (b)„ an operator 
operates a robot body using an operating st ation 20 , and equips a head with the ima ge pick-up sec tion 21 
and the stereo headphone microphone 22. 

[0013] The operating station 20 is equipped with the di splay 30 for di splaying the image picturized with 
the camera of a robot body, as shown in drawing 1 (c), and power-source ON **** 31 which performs 
power-source the enter end of the whole system, and there is a head coo frol uni t 32 which operates the 
head of a robot body further. The head control unit 32 can be used as a look control unit by switch of a 
head / look change-over switch 33. If it becomes a look control unit and leans in front by specifically 
pushing a head / look change-over switch 33, a camej_Jj_ill turn to the bottom, and a top will be turned 
to if it leans back. Moreover, if it becomes a head control unit and leans in front by lifting a finger from 
a head / look change-over switch 33, a head will turn to the bottom, if it leans back, a top will be turned 
to, and a head can be converted now to right and left by leaning to right and left. The inclination of the 
rod operates a motion of the arm of skill, and, as for the skill drive control unit34, the carbon button of 
the grip section side face operates a motion of a finger. By specifically pushing the carbon button of a 
grip section side face, a finger will be in the condition of having bent and a finger will be in the 
condition of having lengthened, by detaching. Furthermore, an arm can be moved all around by leaning 
the rod of the skill drive control unit 34. Moreover, by pushing skill / transit change-over s^tgh35^it 
becomes a transit control unit and a motion_o£a traveller 9 can be operated. A rob ot body is mov ed 
f orward and backwar d, and it is made to convert to right and left by leaning a rod. If the flexible control 
unit 36 operates telescopic motion of the flexible de vice 7 and lengthens a tongue t o the front, it will be 
shrunk, and if it pushes back, it can be lengthened.' : TKe sound volume of the stereo h eadphon e 22 can be 
taken up and down by the voice controller's 37 consisting of two annular tongues arranged at the same 
axle, and being able to take up and down the sound volume of the loudspeaker 4 of a robot body by 
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turning a lower tongue, and turning an upper tongue. The zoom control unit 42 operates the field of view 
of a camera 1, by lengthening a tongue to the front, can make a field of view large and can narrow it by 
pushing back. Moreover, by pushing the laser pointer switch 41, the laser pointer 6 of a robot body is 
made to turn on, and the carbon button of the grip section side face of the right-hand side manual drive 
control unit 34 changes to coincidence at a thing with the actuation function to move the projection 
direction of the laser pointer 6. By pushing the laser pointer switch 41 again, the laser pointer 6 is 
switched off and the function of the carbon button of the grip section side face of the right-hand side ^ 
skill drive control unit 34 is restored to coincidence. 

[0014] Next, actuation of each block is explained using drawing 2 . Drawing 2 is the block diagram of a 
robot body, and the same number same name explained to drawing 1 explains the same actuation. As the 
other thing, there is a camera mechanical component 10 in ji head, and the direction of the visual field of 
a camera 1 is moved accordin g to actuation of the look contro ljinitJ32 shown by drawing 1 (c). The 
head drive control section 1 1 controls the head mechanical component 12 according to a motion of the 
head control unit 32 of drawing 1 (c). Furthermore, the head drive control section 1 1 also performs 
control of the camera 1 with which a head is equipped, a disp lay 2, t he stereo micro phone 3, and the 
camera mec hanical compon ent 10 together. Moreover, in the part in idiosoma, CPU body 5a is equipped 
with the information processi ng sectio n, a store , the encryption processing section, and the image 
processi ng sectio n, and perfor ms data proce ssing of this whole robot equipment, and control. 
Communication link unit5fei§ a unit which performs the communication link with a n operating station 
20. Moreover, the skill drive control section 13 performs a fuselage station and control by the whole 
skiirpart, and is equipped with the la ser pointer 6 in the skill mechanical component 14, and can make 
the laser pointer 6 turn on and switch off by actuation of the laser pointer switch 41 of an operating 
station. The foot is equipped with the power unit 8 and the flexible control section 15. The flexible 
mechanical component 16 can be operated by motion of the flexible control section 15. Moreover, the 
transit mechanical component 18 can be moved by the command of the transit control section 17 of a 
foot. 

[0015] Next, the drive approach of robot actuation is explained based on drawing 3 . Drawing 3 is the 
block diagram of an operating station. Since the thing of the same number same name with which this 
was also shown in drawing 1 (c) is a thing of the same actuation, it omits explanation, what performs the 
communication link with communication l ink unit 5b which ^xplaine dpreviously the communication 
link unit 38 shown in drawing 3 -- it is - in addition - and the communication link with the image pick- 
up section 21 an d the stereo headphone micr ophone 22 with which an operator's head was equipped is 
performed. The storage section 39 can m emorize once the information which once memorizes the 
information sent from robot equipment, and is displayed on th e display 30 of an ope rating station. The 
control processing section 4 0 controls a communication link un it etc. while controlling the operating 
station 20 whole. Moreover, the communication li nkunit23 ca n transmit and receive the information on 
the stereo headphone microphone 22 with which theliead was equipped, and the image pick-up section 
21. 

[0016] Then, the flow of the outline about this robot equipment is explained based on a flow chart. In 
drawing 4 , the flow of remote place communication is shown first. The remote place in which an 
op erator is pres ent, and the conferen ce hall where the meeting is held can be transmitted and received by 
the communic a tion link units 5b and 38 explained previously. The image of a remote place and the 
information on audio are first received by the operating station 20, and the condition is displayed on a 
display 30 (SI). It is judged whether a look change is made according to the condition of the display 
(S2), and look migration is performed by transit and a height drive, a head drive, camera look 
adjustment, etc. when a look change should be made (S3). Next, it is judged whether voice adjustment is 
carried out according to the receive state of the stereo headphone 22, and (S4) and when adjusting, 
according to actuation of the voice controller 37 of an operating station 20, loudspeaker volume control 
and reception volume control are performed (S5). Furthermore, it is judged whether skill actuation is 
carried out (S6), and it is performed by actuation of the skill drive control unit 34 of an operating station 
when operating it (S7). Voice can be caught by the robot body by the above actuation (S8), it can talk 
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further, and (S9) and this condition can be transmitted to the operator of a remote place (S10). It is 
specifically transmitted to the direction of a display 30 and the stereo headphone 22, and a condition 
gets across to an operator. 

[0017] Then, a concrete meeting is shown and it explains. A partner is spoken to, when an image and 
voice are received as shown in drawing 5 R> 5 (S21). In this case, if an operator speaks to the 
microphone of the stereo headphone microphone 22, he will be in the condition of addressing to the 
partner of a meeting with that voice being outputted from the loudspeaker 4 of a robot body (S23). 
When carrying out by judging whether a look change is made (S24) on the display 30 of an operating 
station 20, camera angle-of-visibility adjustment can be carried out by actuation which is the zoom 
c arbon butt on 42 further in which what adjustment of each control unit of an operating station performs 
transit and height drive, head drive, camera look adjustment, etc. for can adjust a look (S25). Moreover, 
when shaking hands during a meeting or carrying out actuation of a hand, a hand can be grasped by 
actuation (S28) of (S27) and the skill drive control unit 34 of an operating station, or a hand can be 
raised (S26). When sending data to the display under m e eting, and th e projector of a remote place 
acc ording to the condition of a meeting , it is what is made to transmit data to the projector in the 
personal com puter and conference hall which are not attached to this equipment (S30), and a robot body 
and an operator can advance a meeting, looking at the condition. Furthermore, a robot body can point to 
the contents of the screen of t he pro j ector in a conference hall u sing the laser pointer 6. By specifically 
pushing the laser pointer switch 41 of an operating station 20, the laser pointer 6 with which the skill 
section of robot equipment is equipped can be made to be abl eto turn on, and the light can be applied to 
the screen side of a projector (S31). Moreover, the voice fromthe stereo headphone microphone 22 can 
be transmitted to the loudspeaker 4 of a robot body as voice (S32), further, with the stereo microphone 3 
of a robot body, the voice from a meeting participant can be caught and voice can be transmitted to the 
headphone of an operator's stereo headphone microphone 22 (S33). Actuation of the situation of a 
meeting by the above and voice, and also data presentation is possible by actuation of this robot 
equipment. 
[0018] 

[Effect of the Invention] By the above, even if an operator is not in the conference hall in a remote place, 
a meeting can be heard with the same condition as an attendant, or it can see, or can talk, and the 
condition of the meeting can be further recorded on the storage section of a body. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



TECHNICAL FIELD 

[Field of the Invention] This invention relates to the robot equipment which serves as an operator's other 
self and acts and which is especially used for teleconferencing etc. 
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PRIOR ART 



[Description of the Prior Art] Conventional robot equipment had the industrial robot which does the 
activity of welding, paint, or an assembly instead of human being and which has action controlled by the 
program, and various kinds of sensors and an autonomous type robot with CPU. Moreover, in the 
conventional video conference system, it was what performs an arrangement in a remote place by 
transmitting two or more voice and images of a remote conference half to a mutual conference hall. 



[Translation done.] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgiejje 



9/15/2005 



JP,2002-046088,A [EFFECT OF THE INVENTION] 



Page 1 of 1 



* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated; 



EFFECT OF THE INVENTION 

[Effect of the Invention] By the above, even if an operator is not in the conference hall in a remote place, 
a meeting can be heard with the same condition as an attendant, or it can see, or can talk, and the 
condition of the meeting can be further recorded on the storage section of a body. 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] However, conventional robot equipment was what [ only ] 
carries out fixed actuation to the condition of having repeated the actuation for which the operator itself 
does not grasp the situation of robot equipment and it generally opted, or having been decided, operating 
it. 

[0004] Furthermore, although the signal transduction between two or more remote conference halls is 
based on voice and an image and the arrangement in a remote place was once completed in the 
conventional video conference system, for the participant, it was what I hear that the voice and the 
image which were edited with automatic or hand control must be received, heard and seen, and it is 
passive, and there is no sense of togetherness among participants compared with a meeting in the same 
room, and lacks in presence. 

[0005] This invention is made in view of such a point, the robot equipment of this invention transmits 
the perimeter situation of a robot body to an operator, and it aims at offering the outstanding robot 
equipment which can serve as an operator's own other self. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The whole robot equipment system chart 

(a) The external view of a robot body 

(b) Drawing showing actuation of an operator 

(c) Drawing showing the operating station of robot equipment 
[Drawing 2] The block diagram of a robot body 

[Drawing 3] The block diagram of the operating station of robot equipment 
[Drawing 4] The control flow chart which shows the flow of remote place communication 
[Drawing 5] The control flow chart which shows the example of a meeting 
, [Description of Notations] 

1 Camera 

2 Display 

3 Stereo Microphone Section 

4 Loudspeaker 

5 CPU Body and Communication Link Unit 
5a CPU body 

5b Communication link unit 

6 Laser Pointer 

7 Flexible Device 

8 Power Unit 

9 Traveller 

10 Camera Mechanical Component 

1 1 Head Drive Control Section 

12 Head Mechanical Component 

1 3 Skill Drive Control Section 

14 Skill Mechanical Component 

1 5 Flexible Control Section 

16 Flexible Mechanical Component 

17 Transit Control Section 

1 8 Transit Mechanical Component 

20 Operating Station 

21 Image Pick-up Section 

22 Stereo Headphone Microphone 

23 Communication Link Unit 

30 Display 

31 Power-Source ON**** 

32 Head Control Unit (Look Control Unit) 

33 Head / Look Change-over Switch 



http://www4.ipdl.ncipi.gojp/cgi-bin/tran_web_cgi_ejje 



9/15/2005 



JP,2002-046088,A [DESCRIPTION OF DRAWINGS] 



Page 2 of 2 



34 Skill Drive Control Unit (Transit Control Unit) 

35 Skill / Transit Change-over Switch 

36 Flexible Control Unit 

37 Voice Controller 

38 Communication Link Unit 

39 Storage Section 

40 Control Processing Section 

41 Laser Pointer Switch 

42 Zoom Control Unit 
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DRAWINGS 



[Drawing 11 



[Drawing 2] 
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[Drawing 3] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



9/15/2005 



JP,2002-046088,A [DRAWINGS] 



Page 3 of 5 



20- 



30 
41 

31 
36 
37 
32 > 

33- 



mm® — 



[Drawing 4] 
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[Drawing 5] 
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